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Abstract: We deal in this paper with strategical languages of infinite words, 
that is those generated by a nondeterministic strategy in the sense of game theory. 
We first show the existence of a minimal strategy for such languages, for which we 
give an explicit expression. Then we characterize the family of strategical languages 
as that of closed ones, in the topological space of infinite words. Finally, we give a 
definition of a Nash equilibrium for such languages, that we illustrate with a famous 
example. 

Keywords: Words, infinite words, formal languages, game theory, strategy, topology, Nash 
equilibrium. 

Introduction 

Game theory [6] is usually defined as a mathematical tool used to analyze strategical 
interaction, the game, between individuals which are called players. The games 
studied in this paper are supposed simultaneous, noncooperative, infinitely repeated 
and with a perfect knowledge of the previous moves. We will elucidate these ideas 
through a famous example. 

In game theory, the distinction between the cooperative and noncoperative game 
is crucial. The Prisoner's Dilemma [3] is an interesting example to explain these 
notions. It is a game involving two players where each one has two possible actions 
: cooperate (c) or defect (d). The game consists of simultaneous actions (called 
moves) of both players. It can be represented using the matrix : 
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(4,4) 


(0, 5) 


d 


(5, 0) 


(1, 1) 



where each entry e%j is an ordered pair of real numbers. The two players are referred 
to as the row player and the column player respectively. The actions of the first 
player are identified with the rows of the matrix and those of the second one with the 
columns. If the row player chooses action i and the second action j, the components 
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of the ordered pair eij are the payoff received by the first and the second player 
respectively. It is clear that if they could play cooperatively and make a binding 
agreement, they would both play c. If the game is noncooperative, the best action 
for each player is d. 

Suppose now that we consider infinite repetitions of a noncooperative base game. 
This game is just as noncooperative as the base one, but it allows a certain form 
of interaction. Suppose that each player has a perfect knowledge of the previous 
moves of all the others. Then his strategy may depend on these previous moves and 
he may coordinate it with that of his opponents. For instance, if the base game is 
the Prisoner's Dilemma, grim-trigger is the strategy of cooperating in the first move 
and until your adversary defects, then of always defecting after the first defection of 
your opponent. Tit-for-tat is the strategy of playing at each step the action played 
by your adversary at the previous one ; the initial move is free. 

In this paper, we make use of infinite words to analyze the kind of games we 
want to model. A match of such a game is represented as an infinite word on the 
alphabet A of moves. In this context, a strategy for player i can be viewed as a 
relation from the set of finite words on A to that of the actions of this player. The 
whole strategy of the game is defined as the vector composed by using the strategies 
of all players. We can associate to each strategy vector a language L of infinite 
words on A, defined as the set of all matches that the players may make if everyone 
follows the strategy he decided to apply. 

Nash equilibrium is one of the most important notions in game theory. The 
whole strategy of the game is defined as the vector composed by using the strategies 
of all players. Intuitively, a strategy vector is a Nash equilibrium if one player's 
departure from it while the others remain faithful to it results in punishment. The 
idea is that once the players start playing according to such a strategy vector, then 
they all have a good reason to stay with it. 

More precisely, our study will be organized as follows. In Sections 1 and 2, we 
introduce some basic notions on words and game theory. In Section 3, we show that 
the same language can be generated by several strategies. We call "strategical" a 
language which is given by at least one strategy. Section 4 is devoted to the proof 
of the existence of a minimal strategy for a strategical language, for which we give 
an explicit description. The characterization of the family of strategical languages 
as that of closed sets in the topological space of infinite words is given in Section 
5. Finally, in Section 6, we give a definition of a Nash equilibrium for strategical 
languages. 

1 Words 

A word is a finite sequence of elements of an alphabet A. We denote by A* the set 
of all words on A. The length of a word w £ A* , denoted by \w\, is the number of 
letters of A composing w. Let a £ A. The empty word e is the only word of length 
zero. We denote by \w\ a the number of the occurences of a in w. Given two words 
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u, v G A* , we say that u is a factor of ?; if we have v G ^4*1^* and that u is a prefix 
or a /e/i factor of v if w G u^4* 

An infinite word on ^4 is an infinite sequence h of elements of A, which we will write 

h = h()hi ■ ■ ■ hf ■ ■■ We denote by A u the set of all infinite words on A. Given a 

word w G A* and an infinite word h G ^4", we say that w is a prefix or a Ze/t factor 

of /i if there exists an infinite word /i' G A w such that /i = wh'. 

If L is a subset of A w , we denote by Prefk{L) the set of all words that are prefixes of 

length k of words of L. We set Pre/>fc(L) = [j i>k Prefi(L) and simply Pref(L) = 

Pref> (L). 

Finally, the left quotient of L by a finite word w is the subset w~ l L of A u defined 
by w~ x L = {he A w \wh G L}. 

2 Mathematical model for games 

Noncooperative games, in which moves consist of simultaneous actions of n players, 
can be represented by a collection of n utility functions. The values of these functions 
define the expected amount paid to the players. A game is a tuple G = (P, A, tt) 
where : 

• P = {1, • • • , n}, n G IN, is the set of players. 

• A{ is the set of the actions for player i. 

• A = A\ x . . . x A n is the alphabet of the moves. 

• 7Tj : A — > H. is the utility function for player i. 

• 7r = (tti, . . . , 7r ra ) : A — > IR n is the utility vector. 

We consider in this paper the 5-discounted infinitely repeated game of G, which 
we note by G^ . In such a game, we model a match h as an infinite sequence of 
moves which can be represented by an infinite word on the alphabet of the moves A 
: h = h G hi ■■■hf - 6i". 

The utility with discounting factor 5 G (0, 1) of a match h for player i is defined as : 

oo 

Tti(h) = (i-5)Y J ^{h k )s k - 

Example 2.1 As concerns the Prisoner's Dilemma game, we have P = {1,2}, 
A\ = A2 = {c, d}, A = {c,d} x {c, d} and the utility function is defined by the 
matrix given in the Introduction. The infinite word h = (c, c) w is an example of a 
match in which the two players cooperate infinitely. 
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3 Strategies and languages 

A nondeterministic strategy <Ji for G^, is a relation from A* into Ai that describes 
the behaviour of player i during the game. A strategy vector on A is the relation 
a = (o"i, . . . , o~ n ) : A* — > A defined by : 

(a±, . . . , a n ) G cr(u>) -<=>■ aj G <7j(u>), Vu> G ^4*, Va^ G A i: 1 < i < n. 

Let £ be the set of all strategy vectors on A. We consider now the map 7 : £ — >■ 
7 3 (^4 CJ ), where V{A UJ ) denotes the set of all languages in A^ , which associates to each 
strategy a G X, the language of infinite words 7(0-) given by 

7 (<t) = {/i G A u \ h G o-(e) and h t+1 G <j(/i ■ ■ ■ h t ), Vt > 0}. 

We also write cr — > L to mean that L = 7(0"). 

Example 3.1 We give a strategy for the Prisoner's Dilemma game. 
{(c,c),(c,d)} ifw G (c,c)* 



<r(w;) 



{(d,c),(d,d)} ^G(c,c)*( C ,d)((ci, C ) + (d,d)r 
otherwise 



It is usually called the "grim-trigger" strategy. The language 7(d) is described by 
the co-rational expression 

(ccr + (c,c)*(c,d)((d,c) + (d,d)r. 

Example 3.2 Consider the following strategy a on the alphabet A = {a, 6} : 

a(w) = { ^ a,b ^ V ' W ' a< ' W ' 6 
\ b otherwise 

The language 7(d) associated is 

{h G A w I Pref{h) £ {w £ A* \ \w\ a < \w\ b }}. 

We note that this language is not u -rational, in the sense of language theory. 

Proposition 3.3 The application 7 is neither injective, nor surjective, when | A |> 
1. 

Proof : Let A = A± x . . . x A n be the alphabet of the moves and let 1 < i < n such 
that I Aj |> 2. Let G Aj, 1 < j < n, and let hi G ^4«, 6j 7^ aj. 



1. 7 is not injective. Consider the strategies <r and a' defined as: 
a(w) = 



(ai,...,a n ) ifw G (ai, . . . , a n )* 
otherwise 



and 

(ai, . . . ,a n ) ifw £ (ai, . . . ,a n f 
A otherwise 



a'(w) = 

Obviously a and a'(w) lead to the same language. 
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2. 7 is not surjective. Consider the language 

L = (ai, ... ,a,,... a n )*(ai, ... . .a n ) w ,aj / 6j 

We claim that there is no strategy cr G S verifying cr — >■ L. Indeed, sup- 
pose such a strategy exists. We then have necessarily (cti, . . . , a,, . . . a n ) G 
<r((ai, . . . , Oj, . . . a n )*) Vi > 0, as a consequence of the expression of L. Recall 
the definition of L given at the beginning : 

L = {h € A w \h Q G a(e), ht+i G cj(ft, •••h t )Vt> 0}. 

It implies that (ai, . . . , a^, . . . a n ) w G L, because this word satisfies the required 
conditions, which leads us to a contradiction. 



For a language L, we note S(L) = {a G S| a — > L}, the set of strategies 
generating L. 

Definition 3.4 A language L is strategical if there exists a strategy a G S swc/i i/iaf 
a — >■ L, £/iai is ifS(L) ^ 0. 

4 Minimal strategy 

We define on the set £ of strategies on the alphabet vl the order relation given by : 

a < a' <=> <r(u>) C ct'(w), Vu> G A*. 
It is obviuos to remark that for every family (<7j)j e / of strategies of E, 

Among all the strategies giving a strategical language L, we consider a particular 
one : 

aeS(L) 

We have the following result. 

Proposition 4.1 If L is a strategical language, then ul is the smallest strategy 
giving L. It will be called the minimal strategy of L. 

Proof : It suffices to show that 7 (ox) = L. It will then be obvious that 07 is the 
smallest one. We obtain successively : 
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j(a L ) = {heA UJ \h (£a L (e)andh t+ i£a L (h ...h t ),\/t>0} 

= {heA"\h e fUs(L) ^( e ) and fh+i e n ffe s(L) • • • h), V* > 0} 
= A w |n G cr(e) and a t+ i G cr(a . . . h t ), Vt > 0, V<r G 5(L)} 

= fUs^)^ G ^1^0 G CT ( e ) ^t+i G °"0o • • • th), V/ > 0} 

= n CTG 5(L) 7(ff) 

= flae5(L) ^ 

= L. 



Consider now the particular strategy &l defined as follows : 

<5"l : A* > A 

w i — > Prefi(w^ 1 L). 

Proposition 4.2 For every language L C A w , we have L C 7(o\l). 

Proof : Let h = ho . . .ht . . . G L. We have succesively : 
h^TPreML) = Preh(e~ l L) = a L (e), 

ht+i G Preh((h . . . h t )- l h) C Prehdho . . . h^L), V* > 0. 
Thus, /i G 7(o- L ). 

■ 

To characterize strategical languages of A^, we introduce a new operator. For 
all subsets X C A*, let 

it = {u G A w | n has infinitely many prefixes in X}. 

Example 4.3 We give the value of it for some simple sets X C A*. 

1. IfX = a*b then it = 0. 

2. IfX = (ab) + then it = (o6) w . 

5. // X = (a + b)*b then it = (a*6) w 

Theorem 4.4 L is strategical if and only if L = Pref{L). 

Proof : We first prove that condition is necessary. The inclusion L C Pref(li) 
always holds. 



Let now h G Pref(L), then h has infinitely many prefixes in Pref(L) = {w G A* \ 
3x G A u : wx G L}. This implies that: Vn > 0, 3t n > n, 3x G A w such that 
ho . . . h tn x G L. We know that there exists a strategy a such that L = 7(a). Thus, 
L = {n G A w I ho G <r(e) and /i m G a(h . . . ht), Vt > 0}. Hence: Vn > 0, 3t n > n 
such that ho G cr(e) and a t+ i G cr(no . . . Vi, < i < t n . This implies ho G cr(e) 
and hi + \ G <t(/io • • - hi), Vz > 0. Therefore a G L. 

We now prove the sufficient condition, that is L = Pref(L) then 7(07,) = L. By 
Proposition 4.2, we have only to establish the inclusion 7(07,) C L. Let h G 7(07,). 



6 



We have ho G 07(e) and h t +\ G 07 ( (fro • • • ht) _1 L, Vi > 0. That is, /io G Prefi(L) 
and /i t+ i G Pref\((ho ■ ■ ■ ht) _1 L), Vi > 0. It is clear that /io G Pref(L) and 
V£ > 0,ho---ht G Pref(L). It implies that /i admits an infinite number of left 



factors belonging to Pref(L). Then h £ L since L = Pref(L). 

■ 

The proof that the condition of the previous proposition is sufficient implies 
the following result. 

Corollary 4.5 //L is strategical, then L = 7(07). 

The results obtained so far can be summerized in this way : 

Proposition 4.6 The following properties are equivalent : 

• L is a strategical language. 

• i(<tl) = L. 

• Pref{L) = L. 

It is now possible to give an explicit description of the minimal strategy. In fact, for 
a strategical language L, both strategies <tl and 07 coincide. 

Proposition 4.7 For a strategical language L C A w , we have 07 = 07. 

Proof : It suffices to show that 07 C 07. Let w G ^4^. We have (?l(w) = 
Pref 1 (w- 1 L). Let x G a L {w). Then roi G Pref{L). So : 3h e L, 3t > 
such that u> = ho . . . h t and x = fat+i- Since /i G 7(07), we have necessarily 
ht+i G 07(/i • • • h t ). Thus x G o-l(w). 

■ 

5 Topological impact 

We consider on the set A w the distance d defined as follows : 

d(x, y) = (1 + max{|u;| | u> G Pref(x) fl Pref(y)})^ 1 
with the convention l/oo = 0. 

Proposition 5.1 Equipped with this distance, A w is a complete metric space. 
The next proposition is shown in [2,5]. 



Proposition 5.2 A language L d is closed if and only if L = Pref(L 
Corollary 5.3 L is strategical if and only if L is closed. 
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It is usual to note L the smallest closed language containing L. Corollary 4.5 can 
be generalized to any language of A u in the following manner : 

Proposition 5.4 For all language L C A^ , we have L = 7 (ox). 

Proof : Since we always have L C 7(07,), it is sufficient to prove that 7 (ox) C L. 
Consider a word h G 7 (ox). Recall that : 
7(ox) = {x £ ^ J x G ox(e) and x t+ i G ox(xo ■■■xt), Vt > 0} 

= {x G A" I x G Prefi(L) and x t+ i G Prefi((x ■ ■ • x t ) _1 L) Vi > 0}. 
We have then : /to G Prefi(L) i&3yo G ^4^, /ioyo G L and xt+\ G Prefi((xo ■ ■ ■ xt)~ l L) 
iff 3y m G A", h Q . . . h t+1 y t+1 G L. It implies that : Vt > 0, 3y t ei u , /i • • • /i t y t G 
L. Define now the sequence (h^H)t>o of words of L given by = ho ■ ■ ■ hft/t- It 
appears clearly that it admits the word h as a limit. So h G L. 



6 Nash equilibrium 

Intuitively, a strategy vector is a Nash equilibrium if no player has any interest in 
leaving his strategy, while his opponents remain faithful to theirs. Let us first intro- 
duce some basic notions, in order to give a formal definition of a Nash equilibrium. 
Let a = («i, . . . ,a n ) G A. We call i-variation of a every f3 G A such that Qj ^ fa 
and aj = /3j,Vj ^ i. 

Let X be a language of A u . We call i-variation of a match /i = h$h\ . . . h t . . . in X 
every match /iEl for which there exists i > 0, an i-variation a of /i t and a word 
w E A u such that h = ho . . . ht-iaw G X. 

A 500c? match for player i in X is a match h € X verifying TTi(h) > iTi(h) for every 
i-variation h of /i. Denote by GMi(X) the set of all good matches for player i in X. 

Example 6.1 Consider the language L = (c, c) w + {d,d) w . It is obvious that the 
words (c,c) u and (d, d) w do not admit any i-variation in L. So we have GMj(L) = 
L, Vi = 1,2. 

Example 6.2 Let L = (d, d) w + (d, d)* (d, c)((c, c) + (c, d)) w . JTws language involves 
the Prisoner's dilemma game strategy in which the first player defects as far as his 
adversary defects and cooperates infinitely as soon as his opponent cooperates. We 
claim that h = (d,c)(c,d) u G GM 2 (L) if 5 > 1/5, otherwise (d, d) w G GM 2 (L). 
Indeed, let h be a 2-variation of h. Then h G (d, d) u + (d,d)*((c,c) + (c, d)) w . But, 
at the sight of the payment matrix given in the Introduction, we notice it pay more 
for the second player always to choose d instead of c after his first cooperation. Thus, 
we will only examine the 2-variations belonging to (d, d) w + (d, d)* (d, c)(c, d)^ . We 
obtain successively for n G IN : 

4((d,dr(d, C )(c,dr) = (i-5)(ELo^+Er=n +2 55 fe ) 

= (i - *)E2=o s k + 5QXo * k - I2tl s k )} 

= 1 - 5 n+1 + 5S n+2 
= l + 5 n+1 (55- 1). 
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The case of h = (d,d) u ' can be dropped when 5 > 1/5, because we have l + <5 n+1 (5<5 — 
1) > 1 = ((<i, d)^)- Furthemore, one can easily verify that the maximum of the 
function n i — > 1 + 5 n+1 (55 — 1) is reached for n = 0. Hence, the word (d, c)(c, d) w 
belongs to GM 2 (L). 

The notion of Nash equilibrium also requires the introduction of some basic strategy 
vectors. Let a = (a±, . . . , a n ) be a strategy vector and let X = 7(0") be the associated 
language. We denote by Wi : A* — > Ai the unpredictable strategy for player i, given 
by Wi(w) = Ai, \/w € A*. 

We define for all 1 < i < n, the following strategy vectors : 

= {xux, . . . ,Wi-i,ai,w i+ i, . . . ,w n ) 
i/W = {a\, . . . ,ai-\,Wi,ai + i, . . . ,a n ). 

We denote by Xi the language 7(//** ) ) and by Yi the language 7(1/^). 
Proposition 6.3 We have : 

• X = Dl<i<n^' 

. Y i = f) j ^ i X j Vl<i<n. 

Proof. For the first part, we obtain the succession of equations : 

X = {heA u; \h ea(e)andh t+1 £a(h ...h t ),yt>0} 

= {h € A u \ /to,i G °~i( e ) an d ht+ij € <Tj(/to • • • h t ), VI < i < n, Vi > 0} 

= r\i<i< n i h G A "\ h 0,i G and h t+ i,i £ ai(h . . . h t ), Vi > 0} 

= a<i<„7(Ai (i) ) 

= r\l<i<nXi- 

The second part of the proof is easier, since we immediately obtain by using the 
lines above : 

Yi = {h € A^\ h j € <Tj(e) and h t+1J € aj{h . . .ht), Vt > 0, Vj / i} 

= rv^w) 



Definition 6.4 A strategy vector a = (a±, . . . ,a n ) is a Nash equilibrium if 

n 

f|GM l (y,)/0. 

i=i 

In other words, a strategy vector is a Nash equilibrium if there exists a match that 
represents a good match for each player in the set of matches of the others [3]. In 
particular, in the case of two players, the general definition becomes : 

GM 1 (X 2 )f]GM 2 (X 1 )^(b. 
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Example 6.5 We consider in the Prisoner's Dilemma game, the vector a = (o±, o 2 ) 
in which both players follow the grim-trigger strategy. In this case we have : 

x 1 = (c, c r + (c,c)%c,d)((c,c),(d,d)r, 

X 2 = (c,c) u + (c,c)*(d,c)((c,d),(d,d)r. 

We claim that {01,02) is a Nash equilibrium if and only if the discounting factor 
5 > 1/4. 

Indeed (c,cT € GM 1 {X 2 ) n GM 2 {X 1 ). Suppose h= (c,c) k ' l (c,d)(d,d) UJ be a match 
with defection of the first player at the rank k > 0. We obtain after computations 

4(h) - 4(h) = 5 k (45-l). 

Then 4(h) --k{(K) < iff 5 < 1/4, which proves that h € GM 1 (X 2 ) whenever 5 > 1/4. 
In the same way, we can show that h G GM 2 (X\). 

Conclusion and perspectives 

This paper was essentially devoted to a topological characterization of the family of 
strategical languages. It also embeds a new definition of a Nash equilibrium that 
uses infinite words. 

Our purpose in the future will consist of analyzing more precisely the structure 
of good matches sets, then the strategy vectors that admit Nash equilibria. We also 
wish to study mixed strategies (with probabilities). It is obvious that this kind of 
strategies involves the nondeterministic ones. 
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